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IMPROVED  ARTEF  METHODS  FOR  UNIT  EVALUATION 


Amy  Needs  and  Reward)  Objectives 

A  two-phase  study  of  an  Army  Training  and  Evaluation  Program  (ARTEP)  for 
tank/mechanued  infantry  units1  was  conducted  by  Human  Sciences  Research  (HSR)  for 
the  Army  Research  Institute  (ARIl  The  purposes  of  the  study  were 

•  To  identify  and  examine  major  issues  involved  in  the  current  imple¬ 
mentation  of  the  Army  Training  and  Evaluation  Program  (ARTEP). 

•  To  provide  guidance,  products,  and  recommendations  for  resolution 
of  the  issues  identified 

The  ARTEP  consists  of  concepts,  guidance,  and  training  materials  which  to¬ 
gether  embrace  all  Army  training  Outdance  and  training  materials  for  field  users  are 
still  being  refined  ARTEP  manuals  and  specifically  TAE  Outlines  replace  the  Army 
Training  Programs  which,  since  World  War  II.  provided  the  basic  mission  format  for 
unit  field  training  The  current  ARTEP  TAE  Outlines  arc  performance-oriented  They 
are  designed  to  provide  settings  which  more  realistically  represent  realities  of  the  modem 
battlefield  and  changes  in  tactics  required  to  better  exploit  capabilities  of  new  weaponry. 

The  transition  to  ARTEP  is  still  in  progress  Transitions  from  one  system  and 
set  of  concepts  to  another  is  never  easy  *  The  study  sought  to  provide  guidance  and  train¬ 
ing  materials  that  would  assist  in  the  transition,  helping  to  assure  that  the  concepts  upon 
which  ARTEP  is  based  are  wisely  and  imaginatively  applied  in  unit  field  training. 

^Contract  DAMf  |i  -77.C -0001 .  Improved  Army  Training  and  Evaluation  Program  (ARTEP) 
Methods  for  t  tilt  Evaluation 

‘Mator  (General  Inhn  W  Setglr.  •'The  Army  Training  System  A  Status  Report."  DC'S!.  HO 
TRADOC.  ACSA  Convention.  October  1**77 
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Results  of  the  study  are  presented  in  seven  separate  report  volumes.  A  scheme 
showing  the  work  steps,  the  reports  resulting  from  these  steps,  and  the  report  titles  is 
shown  in  Chart  1 . 


Problem  Diagnosis  and  lane  Identification- Volume  I 

Methodology 

An  iterative  case  study  method  was  used  to  identify  relevant  issues  and  problems. 
Cases  consisted  of  observations  of  the  conduct  of  field  exercises  for  battalions  drawn  from 
three  divisions,  and  discussions  with  key  planners  and  supervisors  of  unit  training  in  a 
fourth  division  This  permitted  documentation  of  current  field  practices  in  implementa¬ 
tion  of  ARTFP.  Comparison  of  cases  permitted  identification  of  recurrent  problems 

Along  with  observation  of  cases,  we  interviewed  cognizant  officers  at  TRADOC/ 
FORSCT)M  schools  and  operational  divisions  Two  symposia  on  ARTFP  were  held.  Con¬ 
cepts  and  methods  from  the  scientific  literature  (learning  theory,  systems  analysis,  psycho¬ 
metric  methods,  etc.  I  were  reviewed  to  determine  their  relevance  to  problems  encountered 
and  for  their  contributions  to  solutions  Together,  the  scientific  literature  and  military 
sources  suggested  directions  for  recommended  solutions 

A  schematic  showing  research  methodology  and  products  from  the  first  phase 
of  study  is  presented  as  Chart  2. 

Claanficabon  of  Umes  Probiema 

Issues  and  problems  were  classified  as  shown  in  four  columns  in  Chart  3.  they 
are  presented  as  questions  needing  resolution.  While  the  four  columns  do  not  exactly 
map  the  formal  functions  of  Army  organizations,  they  roughly  correspond  to  roles  and 
responsibilities  of  Army  ecnclons  from  TRADOC/FORSCOM  down  in  descending  order. 

•  Column  I.  These  issues  pertain  to  concepts  and  guidances  which 
emanate  from  TRADOC/FORSCOM. 
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CHART  I  Sludin  of  ARTfcP*  Slept  and  Rrtrarch  Product* 


CHART  2 

SCHEMATIC  RESEARCH  METHODOLOGY 


CHART  3:  CUnaification  of  Major  haue*  in  (hr  Refinement  of  Tank  and 
Mechanized  Infantry  Ta»V  Force  ( ARTFP)  (-valuation* 
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•  Column  II.  This  column  describes  options  aviilable  to  senior  com¬ 
manders  and  training  managers  in  planning  and  conducting  field 
exercises. 

•  Column  111.  Entries  in  this  column  raise  questions  as  to  the  staffing 
of  evaluator  teams,  the  criteria  they  use  to  evaluate,  and  guidance 
needed  to  effectively  use  criteria 

•  Column  IV.  This  column  raises  questions  that  bear  on  integration 
of  results  from  evaluations,  the  use  of  results  to  entique  units,  and 
applications  of  results  as  diagnostic  information  for  training  managers. 

Problem  Arena;  Examples 

The  initial  orientation  of  the  study  placed  heavy'  emphasis  on  improvement  of 
uses  of  mission  TAE  Outlines  (TAEOs)  as  instruments  for  evaluation  of  performance. 

While  problems  exist  in  the  formal  and  use  of  these  instruments,  these  problems  occur 
within  a  broader  mis  of  issues  and  problems,  further,  problems  of  evaluation  cannot  be 
resolved  without  attention  to  these  broader  interrelated  issues  and  problem  areas  Prob¬ 
lems  are  documented  and  discussed  in  the  first  project  report. Among  major  problem 
areas  which,  once  identified,  help  to  better  define  research  directions  are  these 

!  Evaluator  Training  Very  little  time  was  devoted  to  evaluator  training.  Many 
evaluators  had  no  more  experience  than  men  they  evaluated  Elvaluator  team 
work  is  critical  in  company  and  battalion  field  exercises  In  no  instance  did 
we  find  instructions  hearing  on  how  evaluators  should  act  as  a  team. 

2  The  “Integrated"  ARTEP  Insufficient  evaluator  training  led  to  further  com¬ 
plications  in  two  divisions  that  attempted  to  use  the  so-called  “integrated” 
ARTEP  iHcre.  two  battalions  oppose  one  another  )  Since  both  battalions 
were  given  freedom,  interactions  between  battalions  led  to  events  that  were 


'improved  Amy  end  Ftehteilon  hopem  (ARTEP)  Method*  foe  Unit  Fvduenon 

I'ohtme  /.  Executive  Stenmery  Study  Dntgn  end  Field  Rrtrerch  ARI  Technical  Report  TR-78-A26. 
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not  readily  ,  redictahlc  Hence,  the  TA£  Outlines,  which  presume  a  predeter¬ 
mined  sequence  of  a-  tivities  over  time,  were  of  limited  value.  Also,  the  inte¬ 
grated  AR  I  I  P  tor  mobile  units  m  the  hands  ol  controller/evaluators  nut 
trained  to  act  as  a  team  results  in  frequent  mu/vle-to-muz/le  confrontations 
Flements  must  be  disentangled  with  a  resulting  loss  of  training  time  and 
tactical  realism 

'  Principles  ol  learning  AH  1 1  P  missions  jre  to  be  used  primarily  for  training, 
diagnosis,  and  remedy  ol  performance  errors,  however  the  way  in  which  they 
were  administered  is  incompatible  with  well-established  principles  ol  learning 
Attempts  to  include  as  many  missions  as  possible  within  a  three-day  exercise 
prosuled  junior  leaders  all  too  little  time  to  practice  troop  leading  procedures 
1  >  pically .  no  critiques  were  held  during  the  three  days,  this  allowed  incorrect 
actions  to  be  practiced  and  repeated  (Some  evaluators  held  critiques  on  an 
“ad  hoc"  basis,  reportedly  with  good  results  I 

4  Integration  of  Ratings  tor  Diagnosis  With  some  few  exceptions,  methods  used 
to  integrate  ratings  did  not  keep  tab  of  the  tspes  of  errors  omissions  specific 
battalion  elements  had  made  High  costs  of  conducting  battalion  field  excr- 
sises  and  the  existence  ol  other  settings  m  which  battalion  elements  can  be 
trained  together  revealed  a  need  to  examine  the  merits  ot  alternative  training 
settings  tin  particular  battle  simulations)  as  training  instruments 

l AH >  formats  Mans  items  in  current  versions  of TAFO  formats  cram 
together  several  parameters  and  call  for  a  single  rating  satisfactory  or 
unsatislac  tors  As  a  result,  in  critiques,  unless  evaluators  have  a  most 
exceptional  memory  thes  cannot  “recapture"  many  ot  the  specific  errors 
omissions  observed 


Die  a.'O'e  are  among  maior  issues  problems  which  were  more  or  less  common  to 
all  battalion  field  exercises  observed  Hies  provided  a  point  ol  departure  lor  further  work 

Development  of  (iukting  Concepts  Volume  II 


I  aulty  practices  in  planning  and  administering  field  exercises  can  manifest  them¬ 
selves  m  a  vanels  ol  different  ways  (.u.dancc .  we  felt,  should  consist  ol  more  than  a  long 
detailed  fist  ot  “do  s"  and  "don  ts."  This  belief  led  to  search  tor  broad  concepts  and  prin¬ 
ciples  which,  if  p;oper|>  understood  by  training  managers  and  evaluators,  could  serve  two 


purpmes 


I  Ihey  could  help  training  managers  and  evaluators  to  Ivcltet  appreciate 
reasons  lor  specific  guidance  provided 

'  rhe>  could  help  training  managers  to  formulate  procedures  conducive 
to  training  and  cllcctive  learning  for  the  great  variet>  ol  situations  they 
face  periodically .  hut  which  are  not  covered  b>  specific  guidance 

4 

Accordingly  .  a  document  was  prepared  which  develop'd  guiding  concepts  and  pnn 
a  pies  Ol  these,  four  are  central 

1  Principles  Derived  Irom  1  earning  Theory  These  hear  on  feedback  to  trainees 
and  feedback  requirements  promptness,  comprehensiveness,  validity .  cndi 
hility.  and  the  manner  in  which  given 

2  Principles  Derived  from  Systems  Operations  Analyses  Principles  from  systems 
analyses  apply  to  the  operations  ol  the  battalion  in  training.  OPTOK.  and  eval¬ 
uator  teams  each  as  a  system,  and  to  interactions  between  these  systems  in  the 
held  Applied  to  the  battalion  in  training,  they  provide  evaluators  clues  as  to 
what  to  look  lor  Applied  lo  the  evaluator  team,  they  help  to  prescribe  team 
lunctions  evaluations  control,  suletv.  administrative  responsibilities  and  how 
these  must  be  integrated  by  coordination  among  team  members 

lob  I  ask  Analysis  and  Psychometrics  These  technical  concepts  and  tools 
help  to  develop  training  objectives  and  tasks,  and  to  assess  the  adequacy 
ol  those  currently  provided  in  training  materials  Psychometrics  can  help 
to  refine  I  Al  items  so  evaluators  can  make  more  thorough  and  valid 
records  of  field  performance. 

J  (actual  Theory  I  actual  theory  is  introduced  as  an  antidote  to  the 
tendency  ol  tack  analvctc  and  psychometncians  to  develop  extensive, 
over detailed  check  lists  The  task  analytic  approach  is  well  suited  in 
Instructional  System  Development  for  hands-on  tasks  that  can  be 
ordered  in  invariant  sequences  It  is  less  well  adapted  to  description 
of  decision-making  incident  to  direction  provided  by  a  battalion 
stalf  As  an  example,  unit  A  develops  a  "best”  plan  of  attack  If 
opposing  unit  B  guesses  this  plan  exactly  .  unit  A's  plan  of  attack 
can  no  longer  be  regarded  as  "best  "  Applications  of  tactical  con¬ 
cepts  have  many  ramifications  They  argue  for  providing  units  in 
training  opportunities  to  try  out  innovative  solutions  They  argue  for 


improved  4miv  Trmnng  tn.1 1  vahmtkm  lARnpiMerhoJi  /or  Vnir  traluan.m 
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training  evaluations  not  to  be  rigidly  tied  to  I&l  O  items,  hut  to  re 
cord  critical  actions  that  nuy  not  be  anticipated  by  1&I  item  formats 
Ihcy  aiguc  111  at  esaluatoi  Hamers  in  holding  critiques  sliould  encourage 
discussion  ot  the  meiits  ot  alternative  courses  ot  action  rather  than 
insisting  on  one  rigid  "school  solution  " 

Hu  above  concepts  provided  guidance  lot  development  ot  prototype  training 

materials 

iXrselopmcnl  and  Checkout  of  Guidance 
Materials  for  t  onducl  of  Field  f  xerciscs  Volume*  III  &  IV 

(•uidatice  materials  were  developed  for  lvu>  audiences  exercise  planners  and 
evaluator  controller  1 1  (I  teams  A  first  attempt  to  draft  such  guidance  lor  battalion 
evaluators  was  made  hastilv  It  does  not  provide  adequate  coverage  ot  functions  of 
certain  kev  elements  ot  battalion  o|vrations  in  ('articular.  tc»r  operations  of  the  battalion 
stall  to  include  tire  support  coordination  with  ar tillers  and  air  It  is  not  recommended 
tor  use  in  its  present  form 

Hie  second  studs  phase  translated  the  initial  cl r a 1 1  into  guidance  lor  company 
and  pi atoon-lescl  evaluations  Ihc  revised  materials  were  reviewed  with  personnel  o(  the 
HOth  Maneuver  I  raining  (  ommand  iMK  land  revived  Guidance  was  then  checked 
further  hv  obsersationv  ot  personnel  ot  the  KOth  Ml<  in  their  conduct  of  platoon  level 
esefc  iscv 

Hie  guidance  that  ev<>lvcd  iv  directed  to  companv  and  platoon -level  mechanized 
infantrs  escrciscv  It  ic  reported  in  three  minlulev  the  rationale  (or  coverage,  a  guide  for 
exercise  planners.  lesson  planv  for  controller  evaluators,  and  an  annex  ('  The  first  module 
chows  how  Phace  I  Held  observations,  principles  of  learning,  and  good  pedagogy  combined 
to  define  the  content  and  approach  used  in  the  second  and  third  modules 

'/mpeorre/  4rm*  framing  an./  /  >atuanon  /V.gram  lARTtPi  Merhod i  /.*  (bir  I  talusrum 
I  Juw  III  I trhi  < rUkJsm r  ARI  Technical  Report  TR  'M.'*  November  |97K 

''/mprorr./  Iimv  framm*  and  /  i-Wuari.m /V.gram  <  4Af  fF/V  Wert.**  /or  Hut  h*lu*mm 
t  .Vurne  IV.  IrUhUn,  r  for  rUnnmt  a-x/  OwJirl  of  Ci*nf*n\  Irrrl  I  trU  /  tmnn  Technical  Final 
Report  tinman  Sciences  Research.  Inc  .  Me  lean.  Virginia  TO  ApnJ  1 9 T9 


1  Tic-  second  module,  a  (dmiiund  Hanning  (iuide.  is  designed  lor  use  by  bjttal- 
lon  level  commanders  and  training  managers  who  must  design,  plan  for,  conduct,  and 
supervise  company  and  platoon-level  field  exercises  It  sets  forth  the  sequence  of  Junc¬ 
tions  to  be  performed  Irom  initial  planning  to  conduct  ol  post-exercise  reviews  lor  the 
planning  evaluation  team  Several  pertinent  points  are  stressed 

I  Husk  AK II  F  principles  ol  training  and  evaluation  are  reviewed  Pie 
importance  of  exploiting  both  principles  in  all  field  exercises  is  stressed 

J  Initial  Hanning  I  valuation  Han  Development  Ilie  requirement  lor 
accurately  determining  the  training  evaluation  needs  ol  the  unit  is 
emphasized  so  that  exercise  objectives  can  be  established  Die  pro¬ 
cess  of  integrating  training  evaluation  objectives  into  mission  and 
scenario  development  is  reviewed  fails  designation  selection  ol 
evaluator  controllers  is  emphasized 

I  Hanning  for  I  valuator  School  Pits  section  stresses  the  importance  of 
well-trained  evaluators  It  explains  that  the  1*01.  as  constructed,  involves 
much  actual  planning  lor  the  exercise,  and  integrates  the  scenario.  OF 
(>l*OKlK  and  sequence  of  esents  prepared  by  the  planning  committee 

4  Monitoring  the  I  valuation  S\  stem  Pie  need  for  monitoring  |x-rfor- 
mjiuc  of  the  evaluation  learn  is  stressed  Responsibility  lor  insuring 
adequate  evaluations  involves  giving  good  evaluator  training.  super- 
vision  of  evaluators  during  the  evetcivr  and  conducting  post-excuisc 
reviews  for  the  evaluator  team  to  determine  how  future  evaluation 
efforts  can  be  improved 

Pie  third  misdule  contains  the  Program  of  Instruction  lo  be  used  in  csalualoi 
controller  training  p-.e  Program  of  Instruction  <  Pol  i  has  1  5  separate  lesson  plan  nnxlulcs. 
complete  with  narratives,  graphics,  and  examples  of  materials  needed  to  conduct  training 
Pic  modules  are  designed  from  a  functional,  task-oriented  perspective  llicy  are  heavily 
oriented  to  practical  exercises  where  evaluators  actually  accomplish  their  planning 
required  lor  the  exercise  Pie  lesson  plan  modules  have  not  been  field-tested,  but  repre¬ 
sent  the  culmination  of  several  revisions,  incorporating  comments  from  Active  Army 
elements 
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Title*  and  major  thrusts  of  the  lesson  plans  are 

•  Introduction  to  ARTFP  Fxeruse  Objectives  The  emphasis  is  on  training  benefits 
in  evaluation  exercises  and  the  importance  of  performance  feedback  to  unit  pro¬ 
ficiency 

•  Fxcrcive  Function  and  Structure  The  purpose  of  the  exercise,  the  role  of  the 
evaluator  controller  team  in  the  exercise,  and  the  need  for  evaluator/controller 
teamwork  is  explained 

•  Introduction  to  Fvaluator  Controller  Duties  This  defines  and  describes  the  ten 
major  duties  of  evaluator 'controllers  and  shows  how  all  duties  relate  to  training 
and  evaluation 

•  (  valuator  Controller*  Plan  for  Performing  Unit  Actions  Uses  an  exercise 
sernano  to  help  evaluator  controllers  anticipate  critical  behaviors  of  units  and 
unit  leaden 

•  Methods  of  Control  Fxplains  why  control  is  necessary  ,  when  to  use  it.  and  per¬ 
mits  evaluator/controllers  to  develop  a  control  plan  for  their  exercise 

•  Communications  Fvaluator  controllers  are  given  communications  nets  and  must 
develop  plans  for  their  communication  with  each  other  throughout  the  exercise 

•  Simulation  This  explains  the  use  of  simulation  to  control  engagements,  move¬ 
ment  of  units,  and  casualty  assessment,  then  permits  evaluator  controllers  to 
develop  their  simulation  plan  lor  the  exercise 

•  Observing, Fvaluating  Performance  Fxplains  how  to  use  TAP.  Mission  Outlines 
what  actions  should  be  observed,  how  to  evaluate  observed  actions  and  apply 
TAF  Outline  standards 

•  Preparation  and  Conduct  of  Cntiqurs  Fxplains  the  importance  of  entiques 
to  learning,  how  to  encourage  performers  to  critique  and  learn  from  it.  points 
to  cover  and  procedure*  to  follow  in  giving  the  cnttqur 

•  Data  Analysis  and  Report  Preparation  Details  the  critical  importance  of  diagnosing 
performance  deficiencies  and  making  training  recommendations  F.xplaim  how  to 
"replay*'  the  exercise  to  make  diagnoses,  and  emphasizes  completing  TAtO  ratings 
as  well  as  how  to  score  difficult  items 

•  Post-Exercise  Cntique  This  emphasizes  using  rrsults  from  data  analysis  to  pro¬ 
vide  more  feedback  to  unit  leaders/trainers,  and  also  emphasizes  positive  use  of 
evaluation  results  for  future  training 


II 


•  Pxerctse  and  Terrain  Rehearsal  Thu  guides  evaluator/controllers 
through  map  and  terrain  rehearsals  with  their  completed  plans  to 
check  for  and  resolve  problems  before  the  exercise  starts 

Guidance  Materials  for  Division  Brigade  and  Battalion 

Concurrently  with  the  above  work.  CPTs  l)  P  (>eorge  and  R.  L.  Cierding. 
while  attending  the  Naval  Post  Graduate  School,  incorporated  much  of  the  matenal 
Irom  our  Phase  I  reports  into  a  guidance  document  for  training  at  division,  brigade 
and  battalion  levels  Working  with  these  and  TRAIXK'  sources.  HSR  scientists  have 
provided  suggestions  and  inputs  to  their  documents 

An  Fxamination  of  Alternative  Training  Settings  Volume  V 

(Xir  Phase  I  study  show  that  in  the  transition  from  ATPs  and  ATTs  to  ARTI  P. 
certain  guiding  concepts  and  principles  (or  field  applications  were  not  well  understood 
by  training  managers  responsible  for  ARTI  P  Among  problem  areas  identified  were 
centralization  of  responsibility  at  battalion  level,  the  conduct  of  effective  training  in 
an  austere  environment,  and.  in  particular,  management  of  concurrent  multi-echelon 
training  Reasons  for  emphasis  on  concurrent  multi-echelon  training  namely,  person¬ 
nel  turbulence  were  appreciated  by  all  How  to  conduct  such  training  efficiently  was 
not  dearly .  the  transition  from  the  lock -step  training  schedule  prescribed  in  ATTs 
which .  at  least,  everyone  could  understand  to  concurrent  multi-echelon  training,  places 
greater  requirements  for  planning  on  battalion  staffs  Further  guidance  is  needed  One 
focal  point  for  guidance  involves  belter  exploitation  of  several  available  training  settings 
for  the  training  of  units  and  leaders  Substantial  effort  was  devoted  to  an  examination 
of  alternative  training  settings  The  results  of  this  effort  are  reported  in  a  separate  volume 
of  this  report  senes  The  research  issues  and  processes  leading  to  Volume  V  arc  desenbed 
below 

Imtmntd  Army  Thtfsaig  md  EmtmUtm  /Vug mm  (ARTE?)  Mrthoth  for  Omt  Emhuum 
I  'Aymr  V.  Amir* i  of  Trmnirtt  Srttmgt  Final  Technical  Report  Human  Sciences  Research.  Inc  . 

Me  lean.  Virginia  10  April  1 070 
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Since  our  Phase  I  study  was  directed  toward  battalion-level  field  exercises.  assess¬ 
ment  of  training  settings  can  be  directed  toward  integration  of  other  settings  that  provide 
opportunities  for  training  into  such  exercises.  In  this  case,  two  questions  may  be  asked 
What  training  should  precede  battalion  field  exercises  ’  Or.  having  diagnosed  training  needs 
in  battalion  field  exercises  What  settings  are  most  appropriate  for  remedial  training  of  bat¬ 
talion  elements  and  leaders’  However,  whether  use  ol  alternative  settings  is  married  to  bat¬ 
talion  field  exercises  or  not.  guidance  lor  fully  exploiting  all  settings  should  be  useful  to 
training  managers  who  have  been  directed  to  plan  concurrent  multi-echelon  training  in  a 
resource-limited  environment  The  issue  becomes  more  salient  in  view  of  certain  types  of 
simulations  which  have  been  developed  in  recent  years  to  train  unit  leaders. 

Training  Settings  Described 

Nine  settings  were  identified  for  study 

•  Conventional  ARTVP  exercises 

•  1  ngagement  simulation  exercises 

•  CATTS  (Combined  Arms  Tactical  Training  Simulator! 

•  CAMMS  (Computer- Assisted  Map  Maneuver  System! 

•  Pegasus 

•  TV  WT  (Tactical  Vxcrcne  Without  Troops! 

•  (TX  (Command  Post  Vxerctse) 

•  Dunn-Kcmpf 

•  SCUt*.  (Small  Combat  Unit  (-valuation) 

Next,  some  35  parameters  or  dimensions  were  defined  so  as  to  provide  a  full 
description  of  each  setting 

1  Description  of  the  setting,  scenario,  and  how  the  tasks  art  presented 
to  players. 

2  Player  tasks  and  how  they  were  conducted 

3  Requirements  for  administration,  to  include  equipment,  controllers/ 
evaluators  auxiliaries 
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4.  Provision*  for  mrisurrmrnl  of  performance,  diagnosis,  and  correc* 
tion  of  deficiencies. 

Sellings  were  organized  as  two  clusters  field  exercises  and  battle  simulations 
and  comparisons  were  made  between  and  within  clusters. 


Comparisons  Between  Field  Exercises  and 
Battle  Simulations 

Comparisons  between  field  exercises  and  simulations,  or  between  simulations, 
are  not  definitive  because  in  most  instances  the  training  value  of  simulations  has  not  been 
empirically  validated  by  systematic  studies  Nonetheless,  certain  important  conclusions 
emerge  from  comparisons. 

Simulations  are  for  training  leaders  As  such,  they  appear  to  be  superior  to 
field  exercises  for  training  battalion  staff  personnel,  and  useful  for  training  company  and 
platoon  leaders  fhese  conclusions  placed  stress  on  using  field  exercises  for  the  training 
to  which  they  arc  uniquely  adapted 

•  Cse  of  field  exercises  to  develop  habits  of  accepting  and  responding 
to  orders,  of  practicing  troop  leading  procedures,  and  to  allow  junior 
level  leaders  to  detec  t  and  correct  errors  by  subordinates. 

•  Exploit  and  encourage  opportunities  of  peers  to  assist  one  another  and 
to  coordinate  their  activities  without  specific  instructions  from  above 
Lower  echelon  personnel  who  can  and  will  do  this  within  established 
mission  goals  greatly  unburden  their  leaders 

Companion  of  Conventional  ARTEF 
M  muons  with  Engagement  Simulation 

Engagement  simulation  such  as  RE  Al  TRAIN  and  MILES  is  still  under  develop¬ 
ment  Thus  far.  it  has  been  successfully  used  at  squad,  platoon,  and  company  (minus)  levels 
Nonetheless,  certain  conclusions  are  warranted 


•  -» -  a 
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Engagement  simulation,  with  rules  of  engagement  properly  played,  provides  a  far 
more  realistic  means  for  playing  the  action  and  counteractions  that  occur  between  sides  in 
the  battle  Interactions  between  sides  often  lead  to  key  framing  points  that  were  not  antici¬ 
pated  in  training  plans.  Trainees  must  leant  to  recognize  and  exploit  these.  The  competitive 
environment  and  high  interest,  which  serve  as  a  motivation  during  engagement  simulation 
exercises,  can  be  maintained  in  post -exercise  critiques  in  which  players  from  both  sides  partici¬ 
pate 

Engagement  simulation  is  a  more  precise  training  tool  than  conventional  ARTEP 
missions  It  requires  added  equipment  It  must  be  well  planned  and  administered  if  its  poten¬ 
tial  advantages  arc  to  be  realized  It  requires  training  controllers  so  they  can  quickly  recon¬ 
struct  the  battle  validly,  detest  key  astions  of  players  not  anticipated  in  mission  plans,  and 
effectively  conduct  After  Action  Reviews 

Comparisons  Among  Simulations 

Two  features  that  discriminate  among  battle  simulations  arc  whether  setup  work 
is  to  be  performed  at  a  central  facility  or  locally,  and  the  extent  to  which  data  for  players  are 
generated  stored  automatically  or  manually  CATTS  and  Pegasus  are  simulations  for  training 
battalion  staffs  that  exemplify  these  differences  CATTS  is  the  most  sophisticated  simulation 
for  the  battalion  staff  Rules  of  engagement  are  reestablished .  intemsibilitics  arc  automatically 
computed,  records  arc  made  of  use  rates  of  logistics  Pegasus  is  operated  entirely  manually  with 
game  boards  Having  a  central  facility  (CATTS)  is  especially  advantageous  in  reducing  the  plan¬ 
ning  requirements  placed  on  local  training  managers 

Dunn-Kcmpf  and  SCUE  arc  designed  to  train  company  level  leaders  In  showing  cearly 
the  panorama  of  lone  side  of)  the  battlefield,  they  unrealistically  unburden  trainee-leaden 
Nonetheless,  they  seem  to  have  important  applications  which,  however,  need  to  be  empirically 
established  Each  (Dunn-Kcmpf.  SCUE)  has  certain  features  that  the  other  does  not  Advanta¬ 
geous  features  of  each  might  profitably  be  combined,  in  particular,  means  for  recording  and 
measuring  performance  used  in  SCUE  should  be  adapted  to  Dunn-Krmpf 


Integration  of  Engagement  Simulation  into  ARTEP- Volume  VI 


Engagement  simulation  (ES)  is  undergoing  continued  development  as  a  training 
method  for  increasingly  larger  units  Its  inherent  advantages  of  realism  and  objectivity  in  play 
of  the  battle  make  it  an  attractive  training  alternative.  Army  organizations  and  researchers  are 
working  on  methods  to  smoothly  and  effectively  incorporate  ES  into  the  ARTEP  concept  Con 
tinued  progress  is  being  nude  in  identifying  and  resolving  training-related  issues 

As  a  special  part  of  the  overall  project.  HSR  prepared  a  paper”  that  explores 
the  issues  involved  in  incorporating  ES  into  ARTEP  exercises  where  unit  performance  assess¬ 
ment  and  evaluation  are  also  of  interest 

Since  ES  is  an  entire  training  methodology,  it  has  its  own  procedures  for  design  and 
conduct  of  training  exercises  These  priKedures  differ  from  those  currently  practiced  in  con¬ 
ventional  field  exercises  within  the  ARTEP  framework  The  differences  between  procedures 
and  their  underlying  philosophies  give  nsc  to  several  issues  which  must  be  addressed  if  ES  is 
to  be  incorporated  into  the  ARTEP  framework  for  conducting  unit  evaluations  The  analysts 
focuses  on  the  following  areas 

•  Development  of  accurate  and  comprehensive  criteria  ami  measures 
of  unit  tactical  performance 

•  Structure  and  functions  of  evaluator  controller  teams  who  must 
collect  engagement  outcome  data,  observe,  and  possibly  rate  unit 
tactical  performance 

•  Reduction  and  integration  of  unit  performance  data  collected  by 
TAE  Outlines  or  casualty  records  to  provide  feedback  to  units 
and  training  managers 

•  Delivery  and  use  of  performance  data  collected  from  exercises  to 
help  establish  training  objectives  and  assess  progress  in  training 
programs 


^ImprorrJ  Army  Training  and  I  ralnanon  Program  t  AR TIP)  MrrhoJt  for  (fair  Fraiuanon 
Vohtmr  VI.  Conrmtional  ARTTP  Afomwu  mJ  Ingagrmmi  SimuUnotu  An  fxaminanon  of  Opnom. 
Final  Technical  Report  Human  Sciences  Research.  Inc  .  Me  lean.  Virpma  JO  April  1^79 
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Iliese  issuer.  as  presented.  arc  not  independent  Decisions  made  regarding 
criteria  and  measurements  influence  all  other  areas  The  full  range  of  options  in  all 
issue  areas  are  not  yet  known  and  could  not  he  explored.  However,  the  paper,  as 
structured,  provides  a  point  of  departure  for  further  development  of  sub-issues  and 
analysis  of  means  of  resolving  them 


